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Abstract 

A variety of barriers relating to resources, institutional and administrative policies, skills 
development and attitudes can hinder the ejfectiveness of technology professional development 
resulting in underutilized technology resources and lack of integration of those resources within 
instruction. Multiple methods were used to evaluate the ejfectiveness of a long-term professional 
development academy intended to address those barriers and promote increased use of technol- 
ogy in the academy participants’ instruction. Results revealed significant gains in participants’ 
self-assessed technology skills and computer self-efficacy, with little or no change to self-assessed 
technology integration beliefs and practices despite interview data indicating participants felt 
their teaching had changed as a result of their academy participation. This article suggests the 
design of the academy was successful in addressing some but not all of its intended objectives. 
Suggestions for the design of long-term technology professional development are discussed. 
(Keywords: technology, teacher education, teacher professional development.) 

INTRODUCTION 

There is general agreement among leaders in the field of educational tech- 
nology that, due to a variety of barriers, teachers often fail to capitalize on the 
educational potential offered by technology resources. Barriers are defined as 
any factor preventing or restricting teachers’ use of technology in the classroom 
(Becta, 2003; Ertmer, 1999). Barriers impacting technology integration may be 
grouped into four main categories: resources, institutional and administrative 
support, training and experience, and attitudinal or personality factors. 

Resources have been identified by numerous studies as one of the most per- 
vasive barriers impeding technology integration (Butler & Sellbom, 2002; Dre- 
noyianni & Selwood, 1998; Jenson & Lewis, 2001; Pelgrum 2001; Shamburg, 
2004). Resource barriers may relate to quantitative issues such as insufficient 
computers, peripherals and software licenses as well as limited Internet access 
(Pelgrum 2001; Shamburg, 2004) or qualitative issues such as out-of-date hard- 
ware and software as well as slow or intermittent Internet connections (Butler 
& Sellbom 2002; Shamburg 2004). 

In addition to resource factors, numerous studies have identified institutional 
and administrative barriers as contributing to teachers’ reluctance to integrate 
computers in their classrooms (Cuban, Kirkpatrick, & Peck, 2001; Mumtaz, 
2000; Pelgrum, 2001; Raymond, Lawyer-Brook, Jurley & Duffield, 2005; 
Russell & Bradley, 1997; Shamburg, 2004). For example, some districts ban 
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or restrict teachers from installing their own instructional software on district 
computers (Shamburg, 2004). Another institutional and administrative bar- 
rier to technology use relates to scheduling. Lack of preparation time to plan 
technology infused lessons was identified as a major obstacle, as teachers stated 
technology integration was new to them and their workloads and schedules pre- 
cluded taking time to design lessons that included technology (Butler & Sell- 
bom, 2002; Cuban et al., 2001; Drenoyianni & Selwood, 1998; Mumtaz 2000; 
Pelgrum 2001; Russell & Bradley 1997; Shamburg 2004). Finding time to ex- 
plore technology options may be especially difficult in districts where a focus on 
test preparation is a dominant priority (Shamburg, 2004). Scheduling barriers 
can be particularly acute at schools on a year-round calendar where students are 
in buildings throughout the year, making repair and maintenance of equipment 
difficult (Raymond et ah, 2005). Finally, scheduling and institutional factors 
can leave teachers feeling isolated in self-contained classrooms with little time or 
opportunity to collaborate on technology-based instructional ideas or observe 
each other’s use of technology (Cuban et al. 2001; Wyer, 1994). Compound- 
ing these issues are schedules which can keep technology staff separated from 
faculty, leaving them unavailable to help teachers when problems arise (Mumtaz 
2000; Pelgrum 2001; Russell & Bradley 1997). Teachers can feel uncomfort- 
able asking for help from school technology coordinators who also carry a full 
teaching load. Such teachers may feel reluctant to integrate technology into 
their teaching because they feel uncomfortable imposing on the technology 
coordinator’s time when they need help (Mumtaz 2000; Pelgrum 2001; Russell 
& Bradley 1997). 

Institutional barriers relating to training and experience include insufficient 
professional development focused specifically on technology integration (Butler 
& Sellbom, 2002; Cuban et al. 2001; Loveless, 2003; Mumtaz, 2000; Pelgrum, 
2001; Russell & Bradley, 1997; Subhi, 1999). In a study examining primary 
teachers’ perceptions of Information and Communication Technology (ICT), 
Loveless (2003) found that teachers acknowledged a need for students to be 
well grounded in basic skills, yet saw ICT as a distinct subject, which should 
be taught by a specialist, much like physical education or music. Loveless con- 
cluded that such attitudes may result from professional teacher development 
that is focused on showing evidence of competence in basic computer use rather 
than on developing pedagogy. Additionally, Cuban et al. (2001) found training 
was seldom offered at convenient times for teachers, nor was it specific to their 
needs. Rather than asking teachers what needed to be covered in the training, 
professional development was driven by the trainers hired by the school and 
offered after school hours, with the expectation that teachers would attend the 
trainings on their own time. A lack of support following professional develop- 
ment represents another training related barrier to a teacher’s use of technology 
in instruction (Jenson & Lewis, 2001; Mouza, 2002). Mouza (2002) stated that 
traditional sit-and-get-training sessions without follow-up support have proven 
ineffective in impacting teachers’ technology integration which suggests a need 
for ongoing professional development. 

The impact of teachers’ attitudes and fears towards use of computers in edu- 
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cation represents a fourth category of barrier (Ertmer, 1999; Becta, 2003). 

The anxiety a teacher may feel as he/she attempts to integrate technology into 
classroom curricula can be overwhelming and a major detriment to the use of 
computers (Russell & Bradley, 1997). Christensen (2002) investigated technol- 
ogy attitudes of 60 Texas public elementary school teachers who received needs- 
based instruction on integrating computers into classroom lessons over the 
course of a school year. At the end of the year, teachers’ responses on an attitude 
questionnaire revealed increased positive feelings toward classroom computer 
use as well as a more defined perception of the importance of computers in 
education. However, teachers expressed fears concerning their ability to stay one 
step ahead of technology savvy students, which negatively impacted their con- 
tinued use of technology. Christensen suggests a need for ongoing technology 
integration education to reduce teachers’ anxiety levels as students’ technology 
skills continue to advance. 

Anxiety concerning technology use may also be found in novice teachers who 
are vulnerable to the opinions and attitudes of veterans. Experienced teachers 
who don’t see the value of integrating technology into their classrooms (Abbott 
& Paris, 2000; Hazzan, 2003) can negatively impact the design of instructional 
technologies by less experienced teachers. For example, Hazzan examined nov- 
ice high school mathematics teachers’ attitudes toward integrating technology 
into their instruction. Results revealed perceptions of a negative undercurrent 
from veteran teachers toward such practices, which discouraged novices from 
continuing to include technology in their lessons. 

Another facet of the attitudinal barrier toward technology integration is 
teachers’ perceptions of their computer competency and the adequacy of their 
technology preparation (Drenoyianni & Selwood, 1998; Piper, 2003). Drenoyi- 
anni and Selwood (1998) found that teachers lacking in perceived competence 
in the use of computers were less likely to incorporate computers in their teach- 
ing. In a survey of 1 60 elementary and secondary teachers from 1 1 Pennsylva- 
nian school districts. Piper (2003) reported that self-efficacy had a significant 
influence on the academic use of technology for novice computer users. For 
non-novices, self-efficacy and access to technology resources were eclipsed by 
computer knowledge and perceptions of technology leadership as the most reli- 
able predictors for the instructional use of technology. 

This article describes a long-duration professional development academy fo- 
cused on infusing technology in K-8 instructional settings funded by the U.S. 
Department of Education intended to address the various barriers identified 
above. The article will evaluate the effects of the academy on teachers’ computer 
self-efficacy, technology skills, and beliefs toward technology use and integration 
practices. 

THE TECHNOLOGY ACADEMY MODEL 

The academy was specifically designed to address barriers identified as limit- 
ing the effectiveness of technology professional development. To address the 
barrier of insufficient time to support mastery of skills and integration practices, 
the academy’s duration extended across two academic years. Participants met 
from 8:30 a.m. to 4:30 p.m. daily for 15 days in June 2003, followed by five 
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individual inservice days held during the 2003-2004 academic year. A second 
15-day session in June 2004 was followed by an additional five inservice days 
during the 2004-2005 academic year. 

To address issues related to the expectation that teachers attend professional 
development on their own time without compensation, the academy paid par- 
ticipants a stipend for their attendance and a per diem for meals. Additionally, 
the academy provided motel accommodations for those living beyond commut- 
ing distance for the two, three week summer sessions. The academy also paid 
for teacher substitutes for the one-day inservices held during the academic year. 
Limited equipment barriers were also addressed. All non-computer based mate- 
rials associated with academy instruction (books, software and digital still and 
video cameras) were provided so teachers would have the resources needed to 
implement the instructional ideas and methods learned. 

The academy focused on skills development as stepping stones to new ideas 
and practices for instruction rather than end goals. All instructional activities 
included sharing ideas and examples for classroom uses as well as discussions 
wherein participants generated instructional ideas relevant to their own class- 
rooms. To further sharpen the focus on integration practices, participants com- 
pleted a self-assessment rubric (Johnson, 2000-2001) to identify their current 
level of skills and integration practices at the end of the first summer session. 
The participants then set personal goals for their future instructional use of 
technology. 

To address barriers associated with insufficient support, participants were 
required to provide a signed administrative endorsement from both their prin- 
cipal and superintendent. This was intended to ensure that the district admin- 
istration was both aware and supportive of the teachers participation in the 
academy, including the required attendance of the five, one-day inservices held 
during the academic year. Beyond administrative support, support for individ- 
ual participants was provided through a listserv. Participants shared questions 
and concerns as well as ideas and successes there. 

The academy’s curriculum was based on the International Society for Technol- 
ogy in Education (ISTE) National Educational Technology Standards (NETS) 
(2002) for teachers. Specifically, the curriculum focused on expanding teacher’s 
understanding and abilities with instructional design, the use of technology as a 
support for student instruction, and student centered instruction that requires 
higher-order thinking skills. 

Implementing the Model 

The technology professional development academy was held at a large South- 
western university from June 2003 to May 2005. The academy was developed 
and presented by the author, an assistant professor of educational technology, 
and Susan Bowdoin, an instructor of university-level preservice teacher technol- 
ogy courses. 

Teacher participants were recruited through application forms distributed 
by blanket mailings to school districts throughout New Mexico. Applicants 
provided recommendation letters from administrators or fellow faculty and a 
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description of their experience and training with technology. Applicants with 
limited previous technology training and recommendation letters suggesting an 
eagerness to expand their skills were selected as participants. 

Twenty-five teachers participated during the first year (24 females and one 
male). Participants’ teaching assignments included regular and special educa- 
tion classes in first through ninth grades in public, private and Native American 
schools located in a variety of settings from large inner cities to small towns and 
reservations. Twenty-three participants taught at the elementary level, while the 
two middle school teachers taught English and science/math respectively. Class- 
room teaching experience ranged from one to 30 years, while teachers’ initial 
computer skills ranged from negligible to some expertise working with Micro- 
soft Office and a variety of educational software titles. 

Summer 2003 

The first summer’s curriculum addressed the six NETS for teachers under a 
thematic umbrella focused on the systematic design of instruction intended to 
engage students in higher-order thinking to address essential questions. Par- 
ticipants completed projects and exercises that culminated in the generation of 
lessons applicable to their classrooms. These included well written learning ob- 
jectives aligned with instructional activities and assessment. Skills development 
emphasized bringing all participants to a baseline level of competence concern- 
ing file management, use of Microsoft Office, searching for and validating 
Internet resources, use of a digital still camera, digital microscope and scanner, 
and the creation of Web pages. 

Academic Year 2003 

The five inservice days in the 2003 academic year focused on reviewing skills 
covered during the previous summer, acquainting participants with grant writ- 
ing opportunities and strategies for creating successful applications, introducing 
additional skills and resources for supporting technology-infused instruction, 
and the setting of individual professional development goals. New skills covered 
during the five inservice days included publishing Reale books, taking or creat- 
ing virtual field trips, and use of digital cameras and virtual reality software to 
create panoramic views and spinable objects viewable from 360 degrees. Partici- 
pants were asked to use a rubric (Johnson, 2000-2001) to assess their current 
technology skills and instructional practices — addressing both technical skills 
and the delivery of instruction before setting personal professional development 
goals for the remainder of the training. 

At the end of the academy’s first year, three participants resigned for health 
or family reasons. An additional three participants were dropped for poor at- 
tendance. To take their places, six new female participants were admitted to 
the academy. Their teaching assignments ranged from first through eighth 
grade in regular, gifted and special education classrooms, while their teaching 
experience varied from three to 27 years. Four taught at the elementary level, 
one taught middle school science and one taught a middle school special edu- 
cation class. 
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Summer 2004 

Four goals were addressed during the summer of 2004. The first was to rein- 
force participants’ technology and integration skills through completion of a 
real-world, hands-on project: the development of two instructional Web sites 
for the Maxwell Museum of Anthropology. The first showcased a collection of 
musical instruments from around the world, while the second provided on-line 
access to a diary chronicling life in an Alaskan Eskimo village at the turn of 
the 20* century. Each Web site included links to teaching resources and lesson 
plans focused on an essential question related to the artifacts. 

The second goal was to introduce participants to telecooperative and telecol- 
laborative Internet-based projects as described in the book Virtual Architecture 
(Harris, 1998). The third goal was to familiarize participants with digital video 
cameras and editing software and the various ways they could be used to sup- 
port instruction. The final goal was to introduce implementation requirements 
for the various technologies and instructional practices covered during the sum- 
mer 2004 session. Informal observations had revealed that some participants 
were not actively using the materials, resources and ideas from the academy in 
their classrooms. Consequently, permanent ownership of the materials used in 
the second year of the academy was made provisional on participants’ comple- 
tion of classroom projects based on those materials. Accordingly, teachers were 
required to identify or create a telecooperative or telecollaborative project they 
would use in their classroom, as well as develop plans for using digital video in 
their classrooms during the coming academic year. 

To help teachers implement their technology integration plans, support 
groups were created. Members of the group met on each subsequent inservice 
day to share successes and brainstorm potential solutions to challenges they 
encountered. As participants completed required projects, they shared their ex- 
periences and student artifacts with the entire academy. 

Academic Year 2004 

The major goal of the five inservice days held in the 2004 academic year 
was to help teachers use technology in the classroom. The academy revisited 
the concept of essential questions and how technology might be used to sup- 
port inquiry. Additionally, new technology skills and instructional ideas were 
introduced. Participants explored the Library of Congress’s American Memory 
Collection online and identified ways that access to these original source docu- 
ments could be used to support learning in their classrooms. Participants also 
learned to create claymation animations and discussed how they might be used 
instructionally. 

ASSESSING THE MODEL 

The effectiveness of the academy model was assessed through surveys of par- 
ticipants’ self assessed technology skills, beliefs regarding the use of technology 
in classrooms, feelings concerning technology integration in instruction, and 
computer self-efficacy. Additional insight into the effectiveness of the academy 
model was obtained through teacher interviews. 
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Participants completed a Technology Beliefs and Competencies Survey 
(Brinkerhoff, Ku, Glazewski & Brush, 2001) on the first and last days of the 
2003 summer session and again on the final day of the academy. The Technol- 
ogy Beliefs and Competencies Survey was created as part of a Preparing for To- 
morrow’s Teachers to Use Technology (PT3) grant at Arizona State University. 

It was developed through a process of assessing and examining several existing 
surveys for scope and content. Technology skills and beliefs were identified, and 
items covering each were drafted. Content validation was achieved by having 
educational technology faculty examine the survey to ensure the survey objec- 
tives were met and the items were clear. The survey consisted of four sections: 
Background Information, Technology Skills, Technology Beliefs and Technol- 
ogy Integration. The Background Information section contained eight items 
covering such things as grade level assignment, years of teaching experience, 
gender, age and frequency of computer use at home. The Technology Skills 
section included 32 Likert-style items ranked on a four-point scale from, “I 
can’t do this,” to “I can teach others how to do this,” covering the following six 
categories: basic computer operation, use of productivity software, electronic 
communication skills, use of electronic references. World Wide Web utilization, 
and use of multimedia software and hardware. The Cronbach Alpha reliability 
for this section of the survey was 0.96. The third section. Technology Beliefs, 
asked participants to rank 12 Likert-style items regarding the use of technol- 
ogy in classrooms on a four-point scale from “strongly disagree” to “strongly 
agree.” This section had a Cronbach Alpha reliability of 0.69. The final section. 
Technology Integration, contained 1 1 Likert-style items asking participants to 
rank their perception of a variety of factors relating to successful technology in- 
tegration in classrooms on the same four-point scale from “strongly disagree” to 
“strongly agree.” Cronbach Alpha reliability for this part of the survey was 0.96. 

Participants also completed a computer self-efficacy survey on the first and 
last days of the 2003 summer session and again on the last day of the academy 
in 2005. The survey was a modified version of the Computer Self-Efficacy Scale 
(Cassidy & Eachus, n.d.) and consisted of 20 items ranked on a six point scale 
from 1, strongly disagree, to 6, strongly agree. Sample items included, “I enjoy 
working with computers,” and “I find it difficult to get computers to do what I 
want them to.” Cronbach Alpha reliability for the Computer Self-efficacy Sur- 
vey was 0.94. 

Individual, audio-taped interviews were conducted after the final academy 
meeting with six participants selected to represent a cross section of teaching 
assignments, grade levels, and initial technology skills. The protocol included 
three questions, one each concerning perceived change in computer self-efficacy, 
technology skills, and feelings toward technology integration during the course 
of the academy. For example, to uncover changes in feelings concerning tech- 
nology integration, interviewees were asked, “Have your feelings concerning the 
integration of technology within your teaching changed during the course of 
the academy?” Follow-up questions asked participants to describe any change 
if they perceived one, as well as what they attributed any change, or lack of 
change, to. Additional follow-up questions based on individual responses fur- 
ther explored their experience as academy members. 
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Table 1. Computer Skills Results 



Beginning Sum- End Summer 
met Session 2003 Session 2003 

End of Academy 

2005 


M 

SD 

M 

SD 

M 

SD 

Basic Operations 

2.82 

.804 

3.36 

.420 

3.71 

.317 

Productivity Software 

2.42 

.643 

3.33 

.489 

3.58 

.307 

Communications 

2.78 

.783 

3.25 

.534 

3.63 

.388 

Electronic References 

2.50 

.905 

3.46 

.498 

3.56 

.620 

World Wide Web 

2.31 

.664 

3.10 

.441 

3.43 

.565 

Multimedia 

2.34 

.558 

3.25 

.410 

3.60 

.305 

Note. N = 12. Responses range from 4 (I can teach others how to do this) to 1 (I can’t do this). 


DATA ANALYSIS 

Analysis of survey results was limited to those teachers participating in the 
entire two-year academy who completed all three implementations of the sur- 
veys. Participants’ responses were aggregated for the Computer Self-Efficacy 
Scale and within the six subscales (basic operations, productivity software, 
communications, electronic references. World Wide Web, multimedia) of the 
Technology Skills section of the Technology Beliefs and Competencies Survey. 

A one-way repeated-measures analysis of variance (AN OVA) was conducted 
on these aggregated responses, with alpha set at .05 and Bonferroni adjustment 
made when conducting multiple comparisons of main effects. For the Technol- 
ogy Beliefs and Technology Integration sections of the Technology Beliefs and 
Competencies Survey, individual survey items were examined using one-way 
repeated-measures AN OVA. To compensate for the multiple analyses, alpha was 
set to .005 for the initial ANOVAs, and .05 with Bonferroni adjustment for fol- 
low-up comparisons of main effects. An examination of frequency and graphical 
displays showed only minor and statistically non-significant departures from 
statistical assumptions. The sphericity assumption was assessed using Mauchly’s 
Test with the Greenhouse-Geisser adjustment used in cases where the sphericity 
assumption failed. 

Interview data were transcribed, coded and evaluated for emergent themes 
common to participants’ perceptions based on a comparison of categories using 
a thematic analysis approach (Shank, 2002). Next, representative excerpts sup- 
porting those categories were identified. The preliminary analyses was then re- 
fined through telephone interviews with the teachers. Each teacher interviewed 
was asked for his/her perceptions of the validity of the identified themes and 
supporting interview excerpts. Based on this feedback, the analysis was revised a 
final time. 
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Table 2. Technology Beliefs Results 
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Table 3. Technology Integration Results 


End of 

Academy 2005 

as 

0.52 

c^ 

o 

00 

Cs 

o 

0.94 

0.83 

0.52 

0.52 

0.47 

0.52 

0.69 

0.69 


3.55 

3.45 

00 

3.09 

3.09 

3.45 

3.55 

3.73 

3.45 

3.45 

3.55 

End Summer 
Session 2003 

SD 

0.75 

0.65 

o 

o 

0.75 

0.75 

0.75 

00 

o 

0.51 

0.67 

0.65 

0.67 


00 

3.27 

3.18 

3.18 

3.18 

3.18 

3.18 

3.64 

3.36 

3.27 

3.36 

Beginning 
Summer 
Session 2003 

SD 

C^ 

00 

o 

0.63 

o 

o 

0.83 

O 

o 

0.83 

0.63 

0.52 

0.60 

o 

o 

00 

o 


3.00 

3.00 

3.09 

3.09 

2.91 

2.91 

3.00 

3.45 

3.18 

3.09 

o 

o 



I integrate computer activities into the curriculum. 

Technology plays an integral role in supporting content learning in my class. 

I encourage students to work collaboratively on technology-based activities. 

I locate and evaluate educational technologies, including software, hardware, 
and online resources for use with my students. 

I require students to use a variety of software tools and electronic resources to 
support learning. 

I use technology to support project- and problem-based learning activities in 
my classroom. 

I use technology in my classroom to help support the state curricular standards. 

I use technology to assist me with classroom management and recordkeeping 
activities (e.g., grading, attendance). 

Technology helps me meet the individual needs of a variety of students in my 
classroom. 

I encourage my students to use technology to demonstrate their knowledge of 
content in non-traditional ways (e.g. Web sites, multimedia products). 

I use technology to design new learning experiences for students incorporating 
the unique capabilities of technology. 

Item 



CO 


\T\ 

\o 


00 

c^ 

o 

- 
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Note. Responses range from 4 (strongly agree) to 1 (strongly disagree). 




RESULTS 

Mean scores and standard deviations for the six subsections of the Computer 
Skills portion of the Technology Beliefs and Competencies Survey are shown in 
Table 1. 

A one-way repeated-measures ANOVA revealed a significant main effect for 
time for all six subsections: Basic Operations F{2, 20) = 9.43, p = .001, eta^ = 
.49; Productivity A(2, 15.078) = 33.22,^ < .001, eta^ = .75; Communications 
F{2, 14.868) = 22.22:, p < .001, eta^ = .67; Electronic References F{2, 22) = 

1 1.04, p < .001, eta^ = .50; World Wide Web F{2, 22) = 21.09,/' < .001, eta^ = 
.66; Multimedia F{2, 20) = 33.1 1, /> < .001, eta^ = .77. Eta squared is a measure 
of practical significance indicating the amount of variance in scores explained 
by the treatment. Eta squared values ranging from .49 to .77 indicate that 49 to 
77% of the variance in the three scores for each section of the computer skills 
survey is attributable to participation in the two-year academy. 

Follow-up analyses of simple main effects revealed a significant difference in 
Basic Operations mean scores between the beginning and end of the academy. 
Significant differences in mean scores for Productivity, Electronic References, 
World Wide Web and Multimedia were revealed between the beginning and 
end of the first summer session and between the beginning and end of the acad- 
emy. Significant differences in Communications mean scores were found to be 
significantly different between the beginning and end of the first summer ses- 
sion, between the end of the first summer session and the end of the academy, 
and between the beginning and end of the academy. 

Mean scores and standard deviation results for the Technology Beliefs section 
of the Technology Beliefs and Competencies Survey are shown in Table 2. 

A one-way repeated-measures ANOVA revealed a significant main effect for 
time for three Technology Beliefs Survey items: A teacher’s job includes teaching 
students how to use technology A(2, 22) = 39.25,/' < .001, eta^ = .78; there’s 
sufficient time to incorporate technology into the curriculum F{2, 14.976) = 
15.17,/' = .001, eta^ = .58; and using technology doesn’t interfere with teacher- 
student interactions F{2, 22) = 8.68,/' = .002, eta^ = .44. 

Follow-up analyses of simple main effects revealed a significant difference 
in mean scores between the end of the first summer session and the end of 
the academy, and between the beginning and end of the academy for all three 
items. 

Mean scores and standard deviation results for the Technology Integration sec- 
tion of the Technology Beliefs and Competencies Survey are shown in Table 3. 

A one-way repeated-measures ANOVA revealed no significant main effect. 

Mean scores and standard deviation results for the Computer Self-Efficacy 
Survey are shown in Table 4. 

The individual item mean scores for the Computer Self-Efficacy Scale were 
aggregated, resulting in an initial overall mean of 3.22 {SD = 0.20), a mean of 
3.32 {SD = 0. 15) at the end of the fist summer session, and a mean of 5. 18 {SD 
= 0.38) at the end of the academy. One-way repeated-measures ANOVA results 
indicated there was a significant main effect for time 7(1.34,10.71) = 199.79, 
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p < .001, eta^ = .96. Mean self-efficacy scores showed litde change from the 
beginning of the academy to the end of the first summer session; however, a 
significant increase in mean self-efficacy, t (8) = 14.08, p >.001, eta^ = .96, was 
revealed when comparing mean self-efficacy at the end of the first summer ses- 
sion to mean self-efficacy at the end of the academy. 

Three themes emerged from the analysis of participant interviews related to 
computer skills, computer self-efficacy and technology beliefs and integration. 

Theme 1 

Participants perceived an increase in their technology skills as a result of their 
academy experiences. 

Concerning initial technology skills, all those interviewed either acknowl- 
edged a minimal starting level or described having the realization that their 
initial self assessment had naively overestimated their skills. One teacher said, 
“When I started it was just basic typing kind of things.” Another stated, “I al- 
ways felt I was pretty good with the computer, but. . .the little tricks, you know, 
with Excel. Things like that. I had no idea.” All these participants indicated the 
academy had raised their technology skill levels. The most frequently cited con- 
tributor to their gains was the various learning experiences and required projects 
related to both software and hardware completed during the academy. When 
asked what had facilitated her perceived increase in skills, one teacher stated, 

“I think the experience from the academy and having time to work with others 
to learn the information.” Another said, “Just what basically was learned in the 
academy. . .all those handouts. I have my notebook so I can refer back to it. I 
love my notebook; it’s underneath my bed.” Another factor identified by several 
participants included individual practice on their own time. One teacher said, 
“Not only do I have the skills you gave me, but I have also taken them and ex- 
perimented. Like, if I can do that, can I do this?” Working with others was also 
perceived as an effective way to reinforce learning and help demonstrate what 
was possible through the sharing of ideas and products. One teacher described 
her feelings this way: “Well, I think just seeing the others. . .1 mean. I’m no- 
where near where a lot of them are, but it’s kind of exciting to see what can be 
done. But I know the basics — a little more than the basics — and can maybe put 
more effort to do what they’re doing.” 

Theme 2 

Participants were less fearful and more confident toward technology following 
completion of the academy. 

All those interviewed expressed that they were feeling more confident toward 
technology as a result of their participation in the academy. As one teacher not- 
ed, “I thought it [technology] was more complicated than it sometimes really 
is. You know, it’s just sometimes really taking the time. I think I felt like it was 
kind of a little nerve wracking. There’s so much there and I didn’t know what to 
do. Now I feel a little bit more like I’m willing to challenge myself to try some- 
thing, you know, a spreadsheet or whatever, where before I would have never at- 
tempted to do that ” These participants also reported feeling less fearful they 
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Table 4. Computer Self-Efficacy Results 
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I can usually deal with most difficulties I encounter when using computers. 

I find working with computers very easy. 

I am very unsure of my abilities to use computers.* 

Computers frighten me.* 

I enjoy working with computers. 

Computers make me much more productive. 

Computers are far too complicated for me.* 

Using computers is something I usually enjoy. 

Sometimes when using a computer, things seem to happen and I don’t know 
why* 

As far as computers goes, I consider myself to be pretty competent. 

Computers help to save me a lot of time. 

I find working with computers very frustrating.* 

I always seem to have problems when trying to use computers.* 
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might damage equipment which had translated into a greater willingness to 
troubleshoot when problems arose. One teacher put it this way: “Well, I think 
just the academy in general showed me what you can do and how you just can’t 
break it. You know, you’ve just got to sort of play with it to figure out the prob- 
lem and troubleshoot and things like that.” Another said, “By no means am I 
an expert. . .but. . .I’m not afraid to try and see what happens . . .you now, like I 
tell the kids, ‘You might lose something, but you can always start over.’” Some 
interviewees reported an increased sense of confidence during discussions of 
technology related topics, feeling they now knew enough to participate in the 
conversation. 

Theme 3 

Participants felt the academy had altered their teaching. 

All the interviewed participants indicated their experience in the academy 
had precipitated more positive attitudes toward technology integration, with 
four interviewees reporting that a consideration of technology integration op- 
tions had become a standard component of their instructional planning. As one 
teacher said, “When I come up with a project or some kind of idea for the class- 
room, I try to automatically see how I can fit technology into it.” 

Additionally, all those interviewed reported the academy had changed their 
teaching; however, the nature of those changes varied. Four interviewees de- 
scribed more frequent use of group and project-based learning, providing 
descriptions such as, “I mean. I’ve always done projects and I’ve always tried 
to use technology, but not integrated. It was always kind of a separate kind of 
Friday club thing. And now it’s throughout [the year] .” Another stated, “When 
I taught history, there would be a chapter test. And [now], it’s more can they 
show me with a project.” 

Two participants indicated they more frequently assumed facilitating roles as 
instructors rather than relying on teacher-centered instructional practices. Said 
one, “Now, I think I’m more of a facilitator. . .instead of a, well, I don’t want to 
say teacher - I’ll say lecturer.” Additionally, two participants reported they more 
frequently put technology in the hands of students rather than maintaining 
control themselves. One described it this way: “It was always me using it [tech- 
nology] and not so much the kids. And through the technology academy that 
we did ... all that hands-on stuff, it was very easy to bring it [student hands-on 
use of technology] back into the classroom.” One participant indicated she was 
now taking control of her students’ computer lab instruction rather than relying 
on the technology instructional aid. Finally, three of those interviewed indicated 
the academy had renewed their interest and enjoyment in teaching as evidenced 
by the comment, “It was like the best thing that ever happened to me because 
it even sparked my interest in education and teaching.” Two went on to suggest 
they felt they were better teachers for having participated in the academy. One 
teacher described his feelings this way: “I figured this [technology] can make 
my life a lot easier, and it has, and I think it’s turned me into a lot better teacher 
because of it.” 
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DISCUSSION 

The purpose of this study was to examine the efficacy of a long-duration, 
professional development academy on teachers’ self-assessed technology skills, 
computer self-efficacy and technology integration beliefs and practices. 

Results suggest the academy was successful in increasing these participants’ 
technology skills. Participants’ self-assessed skills increased significantly over the 
course of the first summer session and maintained that increase through the end 
of the academy program. Two factors may have contributed to this success. First 
was the extended nature of the professional development. At the National Edu- 
cation Summit (1999), Gene Carter noted that the majority of American teach- 
ers receive eight hours or less of professional development annually. In contrast, 
the academy’s first summer session provided roughly 90 hours of curricula 
focused on raising participants’ technology skills through direct instruction and 
a series of exercises and projects. These skills were reinforced during the second 
summer session through creation of the museum Web sites and supporting in- 
structional materials. This provision of instruction and practice over an extend- 
ed time was effective in increasing participants’ self-assessed skills — findings that 
are consistent with Franklin, Turner, Kariuki and Duran (2002), who found it 
can take longer than expected for teachers to gain new technology skills. 

A second possible factor contributing to gains in technology skills has to do 
with the academy schedule and the volunteer nature of the participants. Typi- 
cally, professional development is not specific to teachers’ needs nor offered at 
convenient times (Cuban et al., 2001). In the case of the academy, teachers vol- 
unteered to participate based on their own interest in technology, while most of 
the instruction took place during the summer. 

Results for participants’ computer self-efficacy showed no significant increase 
between the beginning and end of the first summer session. In contrast, there 
was a significant increase between the end of the first summer session and the 
end of the academy. This suggests the academy’s extended duration was key to 
supporting change in these teachers’ feelings toward technology. These findings 
are consistent with those of Milbrath and Kinzie (2000) and Smith (2001), 
who found the development of computer self-efficacy requires time. The acad- 
emy may have supported increases in participants’ computer self-efficacy in a 
number of ways. Specifically, academy participants were required to success- 
fully complete a variety of projects working at times individually, in pairs and 
in groups. Various researchers have reported that mastery experiences with 
computers contribute to an individual’s computer self-efficacy (Kinzie, Del- 
court & Powers, 1994; Martocchio, 1994; Smith, 2001). Working in pairs and 
groups and sharing final projects may also have supported computer self-ef- 
ficacy gains. As one interviewee stated, “I think out of the academy I got more 
out of just being able to work with others, you know. It was so nice just to be 
able all day to. . .banter back and forth and work on projects and stuff and get 
ideas.” According to Smith (2001), computer self-efficacy may be derived from 
vicarious learning through the observation of other people’s successful efforts 
using computers. 
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Results for teachers’ technology beliefs revealed a significant change be- 
tween the end of the first summer session and the end of the academy and 
between the beginning and end of the academy for three Technology Beliefs 
Survey items: a teacher’s job includes teaching students how to use technology; 
there’s sufficient time to incorporate technology into the curriculum; and us- 
ing technology doesn’t interfere with teacher-student interactions. Changes in 
beliefs for these survey items may reflect teacher comments made during both 
whole-group and small, support-group discussions of barriers encountered us- 
ing technology in participants’ classrooms. One consistent comment had to do 
with technical support. If technology was going to be used by teachers, they 
themselves needed to take responsibility for its implementation in terms of time 
and instruction because there was limited technical support. Another factor 
that may have contributed to changes in feelings concerning these three sur- 
vey items was incentive. Rather than letting academy materials sit on teachers’ 
shelves, participants were required to complete projects using those materials 
during the second year of the academy in order to keep them. This incentive 
resulted in most participants using the materials in their classrooms, which may 
have supported increased awareness that there was, indeed, sufficient time to 
incorporate technology into the curriculum. However, informal assessment of 
teachers’ projects, as they were presented to the group at the final meeting of 
the academy, revealed several of low quality. Weaknesses in these projects in- 
cluded minimal if any ties to content objectives, poorly developed instructional 
processes and lack of assessment. In short, the projects appeared to have been 
completed simply to keep the materials. Accordingly, these projects may have 
failed to reflect any potential benefits associated with classroom technology use. 
This may have contributed to the limited number of Technology Beliefs Survey 
items showing significant change. Establishing clearer project expectations as 
well as rubrics for their assessment may have supported completion of higher 
quality projects, which in turn may have translated to more positive ratings of 
technology beliefs. 

Results for teachers’ technology integration practices revealed no significant 
change over the course of the academy for any of the survey items. According to 
a variety of researchers, transitioning teachers from novice technology users to 
effective technology integrators capable of supporting student learning generally 
takes three to five years (Helsel DeWert & Levine Cory, 1998; McKenzie, 2001; 
Saylor & Kehrhahn, 2003; Wasser & McNamara, 1998). Such change is a slow, 
uncomfortable process rather than an event, and as such, requires extended time 
for changes in attitude and acceptance of differing perspectives to take place 
(Horsley & Loucks-Housley, 1998). So, despite the academy’s two year dura- 
tion, it may have encompassed insufficient time to significantly impact these 
participants’ integration practices. Additionally, Guskey (1995) found that the 
magnitude of change individuals are asked to make is inversely related to their 
likelihood of making a change. For these changes to occur, teachers need op- 
portunities to apply newly acquired skills to personal use, experiment with the 
effectiveness of technology in the classroom, and collect student data to justify 
conclusions. Positive student data sufficient to drive a change in technology 


38 


Fall 2006: Volume 39 Number 1 

Copyright © 2006, ISTE (International Society for Technology in Education), 800.336.5191 
(U.S. & Canada) or 541.302.3777 (Int’l), iste@iste.org, www.iste.org. All rights reserved. 



integration practices may have been lacking during the academy. Many par- 
ticipants demonstrated minimal use of the technologies they had been taught 
during the first year of the academy. While a requirement to complete projects 
using the various technologies was implemented in the second year of the 
academy, specifics concerning project implementation were left up to individu- 
als in an effort to allow participants freedom to adapt projects to their specific 
instructional needs. While participants’ projects weren’t formally evaluated, dur- 
ing the sharing of projects some trends became apparent, with many projects 
lacking a clear instructional goal or assessment. The purpose of many projects 
appeared to focus on letting students experience the technology rather than on 
standards-based instructional objectives. As such, these projects may not have 
demonstrated clear learning benefits associated with technology use sufficient to 
impact teachers’ technology integration practices. 

However, findings of no significant change in teachers’ self-reported integra- 
tion practices on the survey stand in contrast to comments made during the in- 
terviews, where all interviewees described feeling their teaching had changed as 
a result of their academy experience. This apparent contradiction may represent 
differing, individualized definitions of technology integration. Pierson (2001) 
investigated teachers at various levels of technology expertise and teaching abil- 
ity who used technology, and how their technology use related to general teach- 
ing practice. Results revealed several assertions illustrating teachers’ attitudes 
toward teaching with technology, including: the ways teachers personally used 
technology determined their definitions of technology integration; teachers 
taught with and about technology according to their own personal learning 
strategies; and teachers’ individual definitions of technology integration directed 
their management of student computer use. These individual interpretations 
concerning the nature of technology integration may not have been captured by 
the Technology Integration section of the survey, suggesting a need for improve- 
ment of the instrument. 

An examination of the Technology Integration Survey items suggests that 
two fundamental constructs were being assessed. Items one, two, four, five, 
seven, and eight investigate aspects of technology integration related to sup- 
porting current teaching practices (see Table 3). As such, change in feelings on 
these items need not reflect a substantive change to teachers’ roles or practices. 

In contrast, the remaining items imply a significant transformation in teaching 
practice from teacher-centered to student-centered instruction. 

These constructs represent two possible intentions for technology professional 
development, both of which were supported by the academy curriculum. How- 
ever, as these participants entered the academy as relative technology novices, 
expecting them to embrace student-centered and problem-based instruction as 
part of the academy curriculum may have been unrealistic despite the academy’s 
extended duration. This raises questions concerning the purpose of technology 
professional development. Harris (2005, Choosing an Agenda section 1) main- 
tains that “using technology as a ‘Trojan horse’ for educational reform has suc- 
ceeded in only a minority of K-12 contexts” and raises ethical issues concerning 
respect for teachers, academic freedom to choose instructional practices that 
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work for their given content and context. In the same vein, Woodbridge (2004) 
suggests any learning opportunity that challenges teachers’ personal beliefs, 
values, and assumptions reflects a barrier that may impede professional develop- 
ment. 

This study has several limitations. First, it relies on self-report data from ques- 
tionnaires and data collected through interviews. Direct observation of teachers 
and evaluation of student products may have provided additional insights into 
the effects of the academy on teaching practice. Coupled to the limited number 
of participants, these factors reduce the validity of the statistical analyses. Addi- 
tionally, other professional development training or teaching experiences occur- 
ring during the extended duration of the academy may have impacted partici- 
pants’ skills and attitudes. Accordingly, these results may best be interpreted as 
preliminary, requiring additional research with larger numbers of individuals to 
more fully assess the academy model. 

Despite these limitations, these results support flndings from previous re- 
search as well as suggest some professional development design considerations 
that may be of value to those planning similar long-term technology training. 
Results from this academy confirm earlier conclusions that there is a need for 
incorporating extended contact hours for instruction and practice of technology 
skills. It also confirms the need to provide necessary materials, so teachers may 
return to their classes and use their new skills and integration ideas immediately. 
Results from this academy also support the following recommendations: 

Center instruction around participants’ teaching interests, using hands-on ac- 
tivities and projects with end products that are shared with the whole group. 

Vary instruction so participants work individually, in pairs, and in small 
groups. 

Hold participants accountable for creating realistic lesson plans based on 
their technology integration ideas. These lesson plans should be assessed by the 
professional development trainers to ensure they meet minimum standards. The 
process of creating lesson plans should be repeated throughout the duration of 
the professional development. 

Hold participants accountable for implementation of their integration ideas. 
One means for doing so might be to require completion of an evaluative re- 
flection on the lesson’s effectiveness. Tesson evaluations and student products 
should be shared. 

Finally, clearly define the goal of the technology professional development 
and design instruction and evaluative assessments focused on that goal. Is the 
intent to teach technology skills, to support infusion of technology into current 
teaching practices, or to promote instructional reform favoring student centered 
and problem-based technology supported instruction? Setting an unambiguous 
goal will foster more focused instruction and assessment of the professional de- 
velopment effort. 
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